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Parametric  cost  models  are  not  a  recent  development.  If  Cheops 
thought  about  cost  at  all  when  building  the  Great  Pyramid  he  would  have 
used  expressions  of  the  type  Y  =  aX  where  X  equals  some  parameter  such 
as  blocks  of  granite  or  number  of  slaves.  Most  estimating  over  the 
centuries  and  even  today  is  in  terms  of  cost  per  pound,  cost  per  foot, 
cost  per  barrel  or  some  other  simple  unit  of  measurement,  all  of  which 
are  simple  parametric  cost  models.  They  were  not  recognized  as  such, 
and  it  seems  to  me  it  was  not  until  the  early  1960's  that  the  term 
parametric  cost  model  became  part  of  the  vocabulary  of  the  defense 
community.  Since  then  Rand  and  a  number  of  other  organizations  have 
been  diligently  cultivating  this  field,  and  parametric  cost  models  have 
grown  in  complexity  and  rigor  to  the  point  where  they  qualify  for  a 
session  at  an  international  meeting  such  as  this  one. 

The  limited  time  makes  it  necessary  to  limit  the  scope  of  this 
presentation,  so  my  remarks  will  be  limited  pretty  much  to  aircraft  cost 
models p  by  extension  they  apply  to  weapon  systems  in  general.  Even  the 
subject^of  aircraft  cost  models  is  a  broad  one.  This  display  lists  some 
of  the  models  in  use  today. 


By  organization:  squadron. 
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Each  has  its  uses,  and  sometimes  those  uses  are  different  from  what 
was  originally  intended.  In  Rand  reports  on  cost  models,  for  example, 
you  will  always  find  a  phrase  warning  the  reader  that  the  model  is  intended 
for  use  in  long-range  planning  studies.  The  warning  is  sincere,  but  we  know 
that  the  models  are  used  for  a  variety  of  other  purposes.  They  are  used 
because  the  inputs  can  be  obtained  easily,  the  time  and  expense  are  minimal, 
and  for  DoD  agencies  generally  there  is  no  alternative.  A  grassroots  estimate 
of  the  kind  performed  by  industry  is  outside  the  capability  of  the  military 
services. 

The  Air  Force  recognized  the  need  for  parametric  cost  models  shortly 
after  it  was  organized.  In  1947  the  Air  Force  published  Source  Book  of 
World  War  II  Basic  Data:  Airframe  Industry  [1],  which  presented  a  number 
of  learning  curves  relating  direct  hours  per  pound  of  airframe  weight  to 
the  cumulative  number  of  aircraft  produced. 


1947  CURVES 


Production  quantity 
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For  quite  a  few  years  direct  factory  hours  were  estimated  -  not 
too  badly  -  from  models  of  that  type.  Most  of  the  early  statistical 
analyses  focused  on  direct  factory  labor  and  learning  curves.  A  1956 
Rand  report,  Cost-Quantity  Relationships  in  the  Airframe  Industry  [2], 
concentrated  on  how  to  estimate  the  slope  of  the  learning  curve,  i.e., 
the  b-value  in  the  expression  Y  =  ax*5,  rather  than  the  a-value,  which 
is  the  direct  hours  per  pound.  The  Air  Force,  however,  continued  to 
publish  industry-wide  data  showing  that  direct  labor  hours  were  increas¬ 
ing.  By  1960  the  industry  average  for  Century-series  fighters  was 
25.86  N  0.361.  Increase  of  40  percent  over  the  1947  figure.  That 
raised  the  question  of  why  Century-series  fighters  should  require  more 
direct  labor  than  other  fighters,  and  for  that  matter  why  bombers  required 
more  than  transports. 

With  curves  of  the  type  shown  no  distinction  was  made  between  a 
10,000-lb  fighter  and  a  15,000~lb  fighter;  both  had  the  same  hours/pound. 
But  the  labor  content  of  an  item  does  not  usually  increase  proportionately 
with  weight.  The  relative  positions  of  the  fighter,  bomber,  and  transport 
curves  are  due  more  to  their  iiffering  sizes  than  to  inherent  differences 
in  design. 


INDUSTRY-WIDE  CURVES 
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In  looking  at  a  plot  of  airframe  data  it  was  clear  that  fighters, 
bombers,  and  transports  were  not  separate  samples.  A  plot  from  a  1962 
Rand  report  [3],  shows  that  all  three  types  are  close  to  a  regression 
line  for  subsonic  aircraft.  Supersonic  aircraft  with  one  exception  are 
all  above  the  line,  thus  suggesting  that  the  critical  distinction  is 
speed,  not  type.  When  speed  was  added  as  another  independent  variable, 
it  proved  to  be  statistically  significant,  and  the  era  of  statistically 
derived  parametric  cost  models  had  arrived  at  Rand. 

The  year  was  1962,  and  statistics  had  not  been  a  prominent  feature 
of  earlier  cost  analyses  for  several  reasons.  First,  and  this  problem 
has  not  changed  much,  the  data  available  were  frequently  too  sparse  to 
support  statistical  analysis.  Statisticians  were  attracted  to  the  reams 
of  data  published  by  the  Air  Force  on  World  War  II  and  post  World  War  II 
aircraft,  but  more  pressing  questions  of  the  1950's  and  early  1960's 
concerned  ballistic  missiles  and  space  systems.  Parametric  cost  models 
were  based  on  curves  drawn  through  three,  two,  or  sometimes  one  point. 

A  second  reason  that  statistical  analysis  was  not  common  will  be 
appreciated  only  by  those  who  can  remember  back  to  the  pre-computer  age. 
Several  laborious  hours  on  a  Friden  calculator  were  required  to  do  what 
can  be  done  today  in  five  minutes  on  a  pocket-sized  hand  calculator.  The 
sheer  volume  of  calculations  required  had  a  strong  inhibiting  effect  on 
researchers. 


DIRECT  LABOR  HOURS  AT 

(UNIT  COST) 
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Also,  back  in  those  days  people  had  to  refer  to  tables  of  logarithms 
when  presented  with  a  parametric  cost  model  such  as  this  one. 


=  Aircratt  maximum  speed  (knots) 

=  Airframe  weight  {thousar«>*  of  pounds) 
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For  those  who  tend  to  confuse  their  mantissas  with  their  character¬ 
istics  the  author  produced  a  nomograph.  The  answers  can  be  read  directly, 
albeit  imprecisely,  by  placing  a  straight-edge  from  X£  to  X^.  For  example, 
the  TFX,  later  to  become  the  F-lll,  was  a  topic  much  discussed  in  1962 
because  of  controversy  over  cost  and  the  awarding  of  the  contract  to  General 
Dynamics  instead  of  Boeing.  Use  of  this  nomograph  would  have  given  an  esti¬ 
mate  of  approximately  200,000  direct  labor  hours  or  6  hr/lb  for  the  100th 
unit. 


(7) 

That  estimate  is  shown  here  along  with  the  contractors'  estimates  and 
the  actual.  Although  the  parametric  estimate  is  low  it  gave  notice  at  the 
time  that  the  bid  estimates  were  questionable. 
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A  few  years  later  the  computational  problem  was  solved  as  computers 
and  statistical  programs  became  available  and  were  relatively  cheap  to  use. 

The  data  problem  remained  as  intractable  as  ever  because  manufacturers  of 
military  equipment  prefer  not  to  disclose  their  costs  to  anyone,  and  costs 
reported  to  the  government  are  seldom  the  kind  needed  by  analysts.  One 
effect  of  that  was  to  continue  working  on  aircraft  airframes  where  Rand  had 
compiled  a  substantial  data  base  over  the  years. 

The  result  was  a  1966  report  [4]  that  presented  a  complete  parametric 
cost  model  for  the  development  and  production  of  airframes.  It  followed  the 
general  pattern  of  the  earlier  study,  but  despite  a  search  for  additional 
independent  variables  that  would  explain  more  of  the  variance,  the  conclusion 
was  that  weight  and  speed  (or  thrust  as  a  proxy  for  speed)  were  still  the 
only  two  that  could  be  justified  statistically. 

Not  everyone  shared  that  conclusion.  OSD/Systems  Analysis  gave  Planning 
Research  Corporation  a  contract  to  develop  an  airframe  model  at  about  that 
time,  and  that  model  had  a  variety  of  interesting  variables  [5].  Some  were 
judgmental  rather  than  statistically  significant,  but  statistical  purity  is 
not  an  essential  feature  of  parametric  cost  models.  Too  much  insistence  on 
it  results  in  the  elimination  of  useful  variables.  Figure  8  lists  the  PRC 
variables  and  the  cost  elements  they  are  associated  with.  Note  that  speed 
at  sea  level  was  found  to  be  a  better  explainer  of  direct  labor  hours  than 
speed  at  altitude,  but  the  opposite  was  true  for  the  other  three  cost  elements. 
The  ratio  -*■  *  ^^T^iT^iihE -  was  an  attemPt  to  introduce  some¬ 

thing  like  a  complexity  factor  into  the  model.  The  model  asserts  that  devel¬ 
opment  costs  of  Naval  aircraft  are  substantially  higher  than  those  of  Air 
Force  aircraft;  and  if  the  user  is  unable  to  estimate  weight  growth,  the  model 
will  make  that  estimate  for  him.  All  in  all  it  was  a  useful  model  for  its  time, 
but  it  did  not  establish  a  pattern  for  future  work. 


Airframe  unit  weight 
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Rand  continued  to  update  its  airframe  models  but  without  any  change 
in  format.  The  reason  was  that  contractors  traditionally  report  costs  by 
functional  cost  element  and  that  is  the  way  the  Air  Force  prefers  to 
estimate  them.  The  accuracy  of  the  overall  estimate  is  always  better, 
however,  than  the  accuracy  of  the  individual  elements,  because  the  data 
are  inconsistent  at  the  cost-element  level.  What  one  company  calls 
engineering  another  company  calls  tooling,  or  a  given  company  will  change 
definitions  to  conform  to  cost-accounting  standards,  and  it  has  never  been 
possible  to  adjust  the  data  to  eliminate  all  discrepancies.  At  the  highest 
level  -  aircraft  cost  -  comparisons  are  most  valid. 

The  U.S.  Navy  contracted  to  have  an  airframe  model  developed  in  1972 
that  had  only  two  cost  elements  -  nonrecurring  and  recurring  costs  [6].  A 
second  major  change  is  that  a  novel  index  of  technological  advance  was 
introduced,  and  a  third  was  that  a  judgment  about  complexity  was  required 
of  the  user.  The  index  of  technological  advance  was  truly  innovative.  A 
review  of  technological  advances  had  led  to  the  conclusion  that  they  were 
occasioned  in  most  cases  by  the  demand  for  increased  fighter  performance. 
From  that  conclusion  it  was  reasoned  that  the  introduction  of  every  new 
fighter  was  a  step  forward  in  technology.  An  index  was  put  together 
beginning  with  the  Nieuport  11  in  1915  and  extending  up  through  the  F-14. 

To  estimate  airframe  cost  an  index  number  could  be  inferred  from  that  list. 
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That  index  and  the  judgmental  complexity  factor  get  at  the  root  of 
the  estimating  problem.  Physical  and  performance  factors  such  as  weight 
and  speed  are  not  sufficient  in  themselves  to  deal  with  next  generation 
aircraft,  but  some  judgmental  factors  are  too  unreliable  to  include  in  a 
parametric  cost  model.  I  tried  an  experiment  at  Rand  several  years  ago 
in  which  several  engineers  considered  knowledgeable  about  aircraft  were 
asked  to  examine  plots  showing  actual  data  on  a  sample  of  aircraft  plus 
an  estimate  based  on  a  cost  model  having  only  weight  and  speed  as  inputs. 
Here  is  one  of  the  plots  for  the  C-5A.  On  the  basis  of  that  information 
and  all  of  their  hindsight  the  engineers  were  asked  whether  the  estimate 
should  be  adjusted  and  if  so,  how?  Perhaps  the  experiment  was  poorly 
devised,  but  the  results  seemed  to  say  that  judgment  is  as  likely  to 
degrade  the  estimate  as  to  improve  it. 


>650  kts 


Airframe  weight  ( 1 000  lbs) 
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What  the  estimating  world  is  continually  looking  for  is  something 
like  the  Time-of-Arrival  equation  developed  at  Rand  a  few  years  ago  for 
military  jet  engines  [7].  That  equation  combines  a  number  of  engine 
characteristics  -  turbine  inlet  temperature,  total  pressure,  weight, 
specific  fuel  consumption,  and  maximum  thrust  -  to  get  what  is  in  effect 
a  technological  index. 


AIRCRAFT  TURBINE  ENGINE  TIME-OF-ARRIVAL  (TOA)  EQUATION 
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That  index,  TOA,  was  then  used  in  an  engine  cost  model  with  not 
completely  satisfactory  results  [8].  One  problem  with  variables  based 
on  time  is  that  they  must  be  updated  every  year  or  two  or  the  estimates 
begin  to  deteriorate. 

A  similar  index  was  developed  at  Rand  for  fighter  aircraft  [9] 
that  attempted  to  predict  first  flight  date  based  on  a  combination  of 
performance  variables.  The  best  equation  included  specific  power,  sus¬ 
tained  load  factor,  frequent  range,  payload  fraction,  and  carrier  capa¬ 
bility.  Unfortunately,  technological  advance  as  measured  by  those  var¬ 
iables  appeared  to  be  totally  unrelated  to  aircraft  cost. 


TZTT 
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The  Rand  engine  model  was  based  entirely  on  statistical  analysis. 

An  alternative  approach  being  pursued  at  about  the  same  time  by  the 
Naval  Air  Development  Center  was  to  begin  with  a  hypothesis  about  the 
factors  that  should  influence  R&D  cost  and  to  establish  a  parametric 
relationship  without  regard  to  the  coef f icients.  The  hypothesis  is 
shown  here.  The  first  independent  variable  says  that  turbine  inlet 
temperature  governs  engine  performance  and  dictates  engine  complexity. 

The  second  says  that  the  development  effort  required  to  achieve  a  specific 
TIT  reduces  with  time.  The  third  stipulates  that  afterburning  engines 
cost  more  to  develop  because  of  the  additional  design  and  testing  required. 

Regression  analysis  was  then  used  to  determine  whether  the  three 
hypotheses  could  be  justified,  and  a  useful  parametric  cost  model  was 
obtained  [10], 
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"Useful"  in  this  context  means  useful  for  trade-off  studies  of 
next-generation  aircraft  where  relative  costs  are  more  important  than 
absolute  costs.  Such  models  are  useful  for  detecting  gross  discrepancies 
in  estimates  by  advocates  of  a  particular  model  or  system.  And  they  are 
useful  where  the  only  information  available  is  a  few  key  parameters  such 
as  weight,  speed,  thrust  or  range.  By  and  large  they  are  developed  by 
statistical  analysis  of  experienced  costs. 

The  goal  for  such  models  is  to  achieve  an  accuracy  of  plus  or  minus 
20  percent.  This  chart  shows  for  a  sample  of  six  airframe  models  how 
often  that  goal  is  achieved  [11].  Deviations  on  the  A-7  also  show  inad¬ 
vertently  how  getting  consistent  data  is  a  continuing  problem.  We  had 
queried  the  manufacturer  specifically  about  the  engineering  hours  in  our 
data  base  for  the  A-7  because  they  seemed  abnormally  low.  After  the 
report  from  which  this  table  is  taken  was  published  we  discovered  that 
because  of  confusion  over  definitions  about  1.5  million  engineering  hours 
had  been  excluded.  Their  inclusion  would  reduce  the  A-7  deviations  sub¬ 
stantially. 

The  time  trend  is  encouraging.  When  the  A-7  is  disregarded,  the 
deviations  exceeding  20  percent  drop  from  fo’^r  in  the  first  Rand  model  to 
zero  in  the  second  Noah  model.  The  good  score  achieved  by  the  latter  is 
based  on  being  able  to  distinguish  between  a  major  technology  advance  and 
a  moderate  technology  advance  before  an  aircraft  begins  development.  My 
experience  is  that  such  judgments  are  often  fallacious,  but  the  point  of 
the  chart  is  that  we  are  making  progress. 
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development  end  production  cost  of  1 00  aircraft. 
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For  this  type  of  model  that  requires  only  a  few  inputs  early  in  a 
weapon  system's  life-cycle  I  am  not  sure  that  much  improvement  is  possible. 
Their  great  advantage  is  that  they  implicitly  assume  that  a  development 
program  will  have  its  full  share  of  problems  and  that  production  will  not 
be  at  a  highly  efficient  rate.  More  detailed  models  take  into  account 
design  differences,  schedule,  volume  of  business,  and  a  number  of  other 
program-peculiar  characteristics.  They  offer  a  promise  of  greater  accuracy, 
but  also  of  greater  inaccuracy  if  early  assumptions  are  over-optimistic. 

The  trend  towards  greater  detail  and  complexity  is  the  path  of  evolution. 
One-celled  models  evolve  into  two-celled  models  and  eventually,  if  you  agree 
with  the  theory  of  natural  selection,  you  could  have  a  model  the  size  of  the 
woolly  mastodon,  which  would  probably  receive  the  same  fate.  Let  me  note 
that  parametric  cost  models  are  developing  in  another  way  as  well.  They  are 
being  used  for  many  purposes  far  removed  from  weapon  systems  -  for  estimating 
the  costs  of  new  industrial  cities  in  Saudi  Arabia  to  give  one  example.  Thus, 
old  problems  may  have  been  solved,  but  new  ones  are  taking  their  place.  I  am 
sure  that  you  people  with  your  fresh  ideas  and  new  techniques  will  progress 
more  quickly  toward  solutions  than  we  have  in  the  past. 
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